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(54) Method and system for associating actions with semantic labels in electronic documents 



(57) A method end system are provided for associ- 
ating actions with semantic labels In an electronic doc- 
ument. The document Is created or edited in an appli- 
cation program module and sections of the electronic 
document are annotated with semantic labels. The ap- 
plication program module passes the semantb labels to 
an action DLL. The action DLL is responsible for com- 
municating with the application program module, trans- 



mitting the labels to actton plug-Ins, and receiving, from 
the action plug-ins, the actions to be associated with the 
labels. The application program module communicates 
with the action DLL to retrieve the actions associated 
with the sennantic labels and displays them to a user. 
The document may be created in extensible Markup 
Language (XML) and may be annotated using XML 
tags. The semantk: labels may be associated with 
strings of text or graphical objects 
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Description 
Field of invention 

[0001 ] The present invention relates to a method and 
system for associating actions with semantic labels in 
an electronic document. 

Background of the Invention 

[0002] Electronic documents such as word process- 
ing documents, e-maii messages, and spreadsheet 
documents typically include semantic inf onnation which 
may be recognized as belonging to a particular semantic 
category and associated with one or more actions rele- 
vant to the category. Recognition and use of this seman- 
tic information provides increased interoperability be- 
tween desldop software applications and other desktop 
applicatjons and/br web-based applications. Exemplary 
functions, features, and operations may include auto- 
matically addressing an e-mail message, performing a 
look up in a ooopemting database, providing a hyperlink 
to one or more Internet web pages and providing en- 
hanced content. 

[0003] One current scheme for recognizing strings in- 
volves utilizing an application program module to pass 
a string of text (e.g., a paragraph) entered Into an elec- 
tronte document to a recognizer The recognizer parses 
the string for known keywords which are then compiled 
into semantic categories. Each recognized string is then 
labeled with the title of the semantte category to which 
It belongs. For example, when a user types the string 
'Bob Smith" which is known to the recognizer as a key- 
word, the recognizer compiles the string Into the seman- 
tic category labeled "name." After the string has been 
compiled, the application program module may display 
to the user a selection of actions associated with the 
semantic category label In the electronk: document. For 
example, the semantte category label "name" may be 
associated with the action "Add name to contacts fold- 4C 
er." 

[0004] Independent software developers are often not 
In the best position to determine all of the semantic in- 
fonnatton that Individual users need to be recognized in 
electronic documents. Cuaent schemes, however, are 
limited in thatthey require strings of text in the electronic 
document to contain keywords which are known to a 
recognizer to incorporate semantic category labels and 
make actions available to the user. That Is, If a string of 
text (e.g.. a person's name) does not match a list of key- ^ 
words known to the recognizer, the string will not be la- 
beled as a semantic category and no actions will be as- 
sociated with the string. Moreover, current schemes are 
further limited in that they are unable to recognize and 
associate actions with non-string data (e.g., Images, S5 
photos, drawings, and other Insertabie objects) which 
may be in a document. 

[0005] Thus, there Is a need for a method and system 



for allowing actions to be associated with artitra7 
strings or other types of content, such as Images, pho- 
tos, drawings and other insertabie objects In an elec- 
tronic document without the need for recognition. 

Summary of the Invention 

[0006] Illustrative embodiments of the present inven- 
tion satisfy the above described needs by providing a 
io method and system for associating actions with seman- 
tically labeled strings of text or other content without the 
need for recognition. 

[0007] In one enibodiment, the present Invention pro- 
vides a method for associating actions %vlth semantic la- 
bels in an electronic document. When the document is 
created or edited in an application program module, sec- 
tions of the electronic document are annotated with se- 
mantic labels. In the present embodiment, the document 
may be created using extensible Maricup Language 
^ (XML) and the semantic labels may be XML tags. The 
appllcatk)n program module then passes the labels to 
an action DLL. The action DLL Is responsible for com- 
munbating with the application program module, trans- 
mitting the labels to actbn plug-Ins, and receiving, from 
^ the actton plug-Ins, the actions to be associated with the 
labels. The application program module communicates 
wltii the action DLL to retrieve the actions associated 
with the semantk: labels and displays them to a user. 
The semantic labels may be associated with strings of 
so text or graphical objects. 

{DOOB] These and otherfeatures, advantages, and as- 
pects of the present invention may be more deariy un- 
derstood and appreciated fomi a review of the following 
detailed description of the disclosed embodiments and 
S9 by reference to the appended drawings and claims. 

Brief Description of the Drawings 



[0009] 



Fig. 1 is a block diagram of a computer that provides 
tile exemplary operating environment for the 
present Invention. 

Fig. 2 is a block diagram illustrating an exemplary 
architecture for use in conjunction with an embodi- 
ment of the present invention. 
Fig. 3 is a flow chart Illustrating a method for incor- 
porating semantic labels and actions during crea- 
tion of an electronic document In accordance witi 
an illustrative embodiment of the present invention 
Fig. 4 is a flow chart illustrating a method for asso 
dating actions with semantic labels In accordance 
with an Illustrative embodiment of the present in- 
vention. 

Detailed Description of illustrative Embodiments 
[0010] The present invention is directed toward a 
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method and system for associating actions with seman- 
tic labels In an electronic document 
[0011] In one embodiment the Invention Is Incorpo- 
rated into a suite of application programs refened to as 
'OFFICE," and more particularly Is Incorporated Into a 
woni processing application program entitled "WORD" 
and a spreadsheet application program entitled "EX* 
CEL; both marlceted by Microsoft Corporation of Red- 
mond, Washington. Briefly described, the application 
programs allow a user to create and edit electronic doc- 
uments by entering characters, symbols, graphical ob- 
jects, and comrnands. 

[0012] In one embodiment, the present invention In- 
cludes associating actions with semantic labels In an 
electronic document. When the document is created In 
an application program module, sections of the electron* 
Ic document are annotated with semantic labels. The 
application program module then passes the labels to 
an acdon DLL. The action DLL Is responsible for com- 
municating with the application program module, trans- 
mitting the labels to action plug-ins, and recehflng, from 
the action plug-ins. the actions to be associated with the 
labels. The application program module communicates 
with the action DLL to retrieve the actions associated 
with the semantic labels and displays them to a user. 
[0013] Having briefly described an Illustrative embod- 
iment of the present invention, an illustrative operating 
environment for the present invention Is described be- 
low. 

Exemplary Operating Environment 

[0014] Referring now to the drawings, In which like nu- 
merals represent like elements throughout the several 
figures, aspects of the present Invention and the exem- 
plary operating environment will be described. 
[0015] Fig. 1 and the following discussion are intend- 
ed to provide a brief, general description of a suitable 
computing environment in whk^h the Invention may be 
implemented. While the Invention will be described In 
the general context of an applicatbn program that runs 
on en operating system in conjunction with a personal 
computer, those skilled in the art will recognize that the 
invention also may be implemented In combination with 
other program modules. Generally, program modules In- 
clude routines, programs, connponents, data structures, 
etc. thatperfomn particular tasks or implement particular 
abstract data types. Moreover, those skilled In the art 
will appreciate that the Invention may be practiced with 
other computer-system configurations, including hand- 
held devices, multiprocessor systems, mteroprocessor- 
based or programmable consumer electronk:s, cell 
phones, minicomputers, mainframe coniputers, and the 
like. The Invention may also be practiced In distributed 
computing environments where tasks are performed by 
remote processing devices that are linked through a 
communications network, in a distributed computing en- 
vironment, program modules nnay be located in both lo- 



cal and remote memory storage devices. 
[0016] With reference to Rg. 1 , an exemplary system 
for implementing the inventkm Includes a conventional 
personal computer 20. Including a processing unit 21 , a 
5 system memory 22, and a system bus 23 that couples 
the system memory to the processing unit 21 . The sys- 
tem memory 22 Includes read only memo^ (ROM) 24 
and random access memory (RAM) 25. A basic input/ 
output system 26 (BIOS), containing the bask: routines 
10 that help to transfer infonnatlon between elements with- 
in the personal computer 20, such as during start-up, is 
stored in ROM 24. The personal computer 20 further in- 
cludes a hard disk drive 27. a magnetic disk drive 28, e. 
g., to read from or write to a removable disk 29, and an 
15 optical disk drive 30, e.g.. for reading a Ci>ROM disk 
31 or to read from or write to other opttoal media. The 
hard disk drive 27, magnetic disk drive 28, and optteal 
disk drive 30 are connected to the system bus 23 by a 
hard disk drive Interface 32, a magnetic disk drive inter- 
face 33, and an optk:al drive Interface 34, respectively. 
The drives and their associated computer-readable me- 
dia provide nonvolatile storage for the personal compu- 
ter 20. Although the description of computer-readable 
media above refers to a hard disk, a removable mag- 
netic disk and a CD-ROM disk, it shoukj be appreciated 
by those skilled in the art that other types of media which 
are readable by a computer, such as magnetk: cas- 
settes, flash memory cards, digital video disks, Bernoulli 
cartridges, and the like, may also be used In the exem- 
plary operating environment 
[0017] A number of program modules may be stored 
In the drives and RAM 25, Including an operating system 
35, one or more applteatlon programs 36, a word proc- 
essor program module 37 (or other type of program 
module), program data 38, and other program modules 
(not shown). 

[0018] A user may enter commands and Infomnatton 
into the personal computer 20 through a keyboard 40 
and pointing device, such as a mouse 42. Other Input 
devices (not shown) may include a microphone, joy- 
stick, game pad, satellite dish, scanner, or the like. 
These and other input devices are often connected to 
the processing unit 21 through a serial port Interface 46 
that is coupled to the system bus, but may be connected 
by other Interfaces, such as a game pott or a universal 
serial bus (USB). A monitor 47 or other type of display 
device is also connected to the system bus 23 via an 
interface, such as a vteleo adapter 48. in addition to the 
monitor, personal computers typically Include other pe- 
ripheral output devices (not shown), such as speakers 
or printers. 

[0019] The personal computer 20 may operate in a 
networked environment using logical connections to 
one or more remote computers, such as a remote com- 
puter 49. The remote computer 49 may be a sender, a 
router, a peer device or other common networi( node, 
and typically includes many or all of the elements de- 
scribed relative to the personal computer 20; although 
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only a memory storage device 50 hae been illustrated 
In Figure 1. The logical connections depicted In Rgure 
1 include e local area network (LAN) 51 and a wide area 
network (WAN) 52. Such networking environments are 
commonplace In offices, enterprise-wide computer net- 
works. Intranets and the internet. 
[0020] When used in a LAN networking environment, 
the personal computer 20 Is connected to the LAN 51 
through a network interface 53. When used in a WAN 
networking environment, the personal computer 20 typ- 
ically Includes a modem 54 or other nneans for estab- 
lishing communk^ations over the WAN 52, such as the 
Internet. The modem 54, which may be internal or ex- 
ternal, is connected to the system bus 23 via the serial 
port Interface 46. In a networked environment, program 
modules depteted relative to the personal connputer 20, 
or portions thereof, nray be stored In the renrK>te memory 
storage device, it will be appreciated that the network 
connections shown are exemplary and other means of 
establishing a communications link between the com- 
puters may be used. 

[0021] Rg. 2 is a block diagram Illustrating an exem- 
plary architecture 200 for use In conjunction with an em- 
bodiment of the present invention. The architecture In* 
eludes an application program nioduie 205, such as 
word processor program module 37 (Fig. 1). The appli- 
cation program module 205 Is able to communicate with 
an action dynamto-link library 215 (hereinafter action 
DLL) as a user Is creating, editing, viewing, etc. an elec- 
trons document. An action is a user-Initiated function 
applied to a typed string or other content such as imag- 
es, photographs, or drawings. The action DLL 215 con- 
trols a number of action plug-ins 225. The action DLL 
also controls a type-action database 230. 
[0022] In an Illustrative embodiment, the action plug- 
ins are Automation Senders. Automation Servers are 
well-known software components which are assembled 
into programs or add functionality to existing programs 
running on the Mk:rosoft WINDOWS® operating sys- 
tem. Automation Servers may be written in a variety of 
computing languages and may be un-plugged from a 
program at run time without having to recompile the pro- 
gram. 

[0023] The action DLL 215 manages the actton plug- 
ins 225 that are ain to execute the actions. The action 
plug-ins 225 may be packaged with the applicBtlon pro- 
gram module 205 or written by third parties to perform 
partteuiar actions that are of Interest to the third party. 
The action plug-Ins provide possible actions to be pre- 
sented to the user based upon the type label associated 
with the string or other content The actton DLL 215 de- 
tennlnes what type label the semantic category Includes 
and cross-references the type label in the type-action 
database 230 with a list of actions to detemriine what 
actions to present to the user, it should be understood 
that, in an illustrative embodiment, the type-action da- 
tabase is not used. Instead, the list of actions is dynanv 
icaliy generated for each type by looking in tlie registry 



to determine which actbns are installed and then que- 
rying the action DLLs to detenmlne which types they ap- 
ply to. 

[0024] After the user chooses an action, the action 
5 DLL 215 manages the appropriate action plug-ins 225 
and passes the necessary information between the ac- 
tion plug-Ins and the applteation program module 205 
80 that the action plug-In may execute the desired ac- 
tion. TVpk:ally, the application program module sends 
10 the action DLL an automation request to invoke the ac- 
tion the user has selected. 

[0025] A download URL may be provided with the 
type labels in case the user's nr^hlne has not stored 
action plug-^ns for these type labels. If the user does not 
15 have the action piug-ln DLL 225 con^esponding to a la- 
bel, then the download URL may be used to navigate 
the user's web browser to an appropriate website to 
download this action plug-in. in other impienf)entatk)ns 
of the invention, multiple downbad URLs may be pro- 
vided for a single type label. 
[0026] Having described an exemplary architecture, 
an exemplary method 300 for semantically labeling 
strings during document creation will be described be- 
k>w in reference to Figs. 2 and 3. 

Method for Incorporating Semantic Labels and 
Acllona during Document Creation 

[0027] Fig. 3 is a flow chart Illustrating a method 300 
for incorporating semantic labels and actions during cre- 
ation of an electronic document Those skilled In the art 
will appreciate that this is a computer-in^iemented 
process that is carried out by the computer in response 
to input from the user and instructions provkied by a pro- 
gram module, in this embodiment, the user may be a 
software deveioper. 

[0028] Refen^ing to Fig. 3. the method 300 begins at 
start step 305 and proceeds to step 310 when the de- 
veloper creates the electronic document In appOcatlon 
program module 205, In one embodiment of the present 
invention, the document may be in a template fonnat 
allowing a user to input strings of text, or other content, 
such as an image, photo or drawing, relevant to the doc- 
ument. For example, if the document is a will template, 
the document may have sections for the user to input 
information such as name, place of residence, executor 
of the estate, and benefteiaries. Or If the document is a 
news article, the document may have sections for the 
user to insert a related photo. Or if the document is a 
business publk^ation, it may have sections for a logo 
graphical .element. In an illustrative embodiment, the 
electronic document is a word processing document or 
a spreadsheet document. However, the method is not 
limited to either of these specific types of electronic doc- 
uments. 

[0029] At step 310, sections of the document are an- 
notated with semantic labels which are to be associated 
with actions built by the deveioper. For example, if the 
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document being created ie a will template tiavlng a sec- 
tion that requests a person's residence and that section 
Is annotated with the semantic label 'Place of Resi- 
dence,' then actions for the "Place of Residence" label 
wUl be available for that section regardless of the text 
string input by the user In one enf)t>odlnnent of the 
present Invention, the document is created in XML and 
annotated using XML tags to label the document The 
XML may be written using any editing tool or XML editing 
tool. For example, the residence section of the will tem- 
plate would be annotated with the <plaoe of re&idence> 
XML element The nnethod 300 then proceeds to step 
315, 

[0030] At step 315, the developer builds action plug- 
Ins 225 to provide and execute the actions for each se- 
mantic label (e.g., XML element) in the annotated doc- 
ument. After a string is labeled with a particular semantic 
label, the user will be able to execute action plug-ins 
pertaining to that label. For example, for the "Place of 
Residence" label in a will document, the developer may 
build actions which provide the user with the option to 
review the laws relating to wills which are particular to 
the user's state of residence. The method 300 then ends 
at step 399. 

Method for Associating Actions with Semantic 
Labels 

[0031 ] Fig. 4 is a flow chart Illustrating a method 400 
for associating the created semantic labels vWth the ac- 
tion plug-ins 225 discussed in Rgs. 2 and 3 above. 
Those skilled in the art will appreciate that this Is a com- 
puter-implemented process that Is carried out by the 
computer in response to Input from the user and Instruc- 
tions provided by a program module. 
[0032] Referring to Fig. 4, the method 400 begins at 
start step 405 and proceeds to step 410 when a user 
opens an electronic document (e.g., the will template 
described in Fig. 3) in application program module 205. 
In one embodiment, the electronic document is a word 
processing document or a spreadsheet document. 
However, the Invention is not limited to either of these 
specific types of electronic documents. 
[0033] At step 415, the user hovers a cursor over a 
string or places the insertion point within a string In a 
section of the document incorporating a semantic label 
causing a dropdown menu to be displayed to the user 
in step 420. The dropdown menu typically displays a list 
of actions associated with a semantic label. The drop- 
down menu typically appears above and to the left of 
the semantb label. For example. It the user types the 
string "Redmond, Washington' In the section labeled 
"Place of Residence* the dropdown menu might display 
an action aliowlng the user to review the law relating to 
wQls in the state of Washington. It should be understood 
that the application program module 205 sends a re- 
quest to tlie action DLL 215 to determine which actions 
are shown with each semantic label. The method then 



proceeds to step 425. 

[0034] In one embodiment of the Invention, applica- 
tion program module 205 may Include the option to dis- 
play an In-document user Interface to indicate the loca- 

5 tion of a semantic label. This in-documerrt user Interface 
may use a colored indication to indicate the location of 
a semantic label such as brackets or underlining. For 
example, if the user types the string "Redmond. Wash- 
ington" in the section of the document labeled as a se- 

10 mantle category with type label "Place of Residence," 
the document may look like this with the brackets indi- 
cating semantic labeling: 



[Redmond, Washington] 



is 



P035] Of oounse, the In-document user Interface may 
be any sort of Indication. 

[0036] At step 425, the user is given the optk)n of se- 
lecting one of the actbns from the dropdown menu dls- 
20 played In step 415. if the user does not select an action, 
the dropdown menu remains displayed until the user po- 
sitions the cursor or insertion point to another section of 
the document, if the user does select an action from the 
dropdown menu (l.e., by clksking on a selection), the 
25 method proceeds to step 430. 

[0037] At step 430 , after the user has selected an ac- 
tion, the action DLL retrieves the selected action from 
the appropriate action plug-in. The action plug-lns pref- 
erably are COM objects that are executed via commu- 
so nk^ation between the appltoation program module and 
the action DLL. Parameters necessary to execute the 
action (the XML markup of the string labeled as being 
of a particular type, the XML martcup of the content rep- 
resenting the cun^ent selection) will be passed from the 
S5 application program module to the action DLL and, in 
turn, passed to the action plug-in. After an actbn has 
been executed, the method returns to step 41 0 in which 
the user may reposition the cursororhover over another 
semantc label In the document The method 400 then 
40 ends at step 499. 

[0038] In another embodiment, actions may be asso- 
ciated with sections of existing documents. For exam- 
ple, a court might receive a legal document, such as a 
property deed, in electronic fomn. The property deed 
45 may already have a specific structure such as the loca- 
tion of the property, the amount paid, and a description 
of the property boundaries. A developer may annotate 
the structure of the document with semantic labels In a 
particular schema (e.g., XML) and build actions to pro- 
so vide functionality for particular elements of the schema 
that appear in the document. Thus, an action associated 
with the location section of the deed may cause a map 
showing the property to be displayed. 
[0039] Although the illustrative embodiments of the 
present invention have been described as implemented 
in a word processing program module, it should be un- 
derstood that the present invention may be implement- 
ed in other program modules, including, but not limited 
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to, XML authoring programs and programs such as the 
"POWERPOll^r® presentation graphics program, the 
"VISIO" diagram drawing program and applications in- 
cluded in the "OFFICE" program module, both marketed 
by Microsoft Coiporation of Redmond, Washington. 
[0040] The architecture of embodiments of the 
present invention is designed to allow developers to pro- 
vide actions for labeled strings or other content such as 
grapliical objects which may include, for example, Im- 
ages, photographs, or drawings. The strings or other 
content may be associated with actions without the need 
for recognizer DLLs or reoognizer piug-ins which are 
limited because they are string based and thus do not 
accurately recognize non-strtng content. The developer 
may annotate sections of the document with semantic 
labels 80 that the actions will be available no matter what 
is Inserted in the annotated sec^on by the user. The ar- 
chitecture also allows developers to write less code to 
provide actions since no recognition Is required. 
[0041] It should be understood that Illustrative embod- 
iments of the present invention are designed to be able 
to function without any action plug-in DLLs. For exam- 
pie, If there are no action plug-in DLLs, then the user 
may be presented with a menu Item that allows the user 
to go to a download site to Install an action plug-in DLL. 
[0042] Although the present invention has been de- 
scribed above as implemented in Illustrative embodi- 
ments, it will be understood that altematlve embodl- 
ments will become apparent to those sidlied In the art to 
which the present Invention pertains without departing 
from its spirit and scope. Accordingly, the scope of the 
present invention is defined by the appended claims 
rather than the foregoing description. 



Clalme 



For an electronic system for creating and editing an 
electronic document, a nrrethod for associating ac- 
tions with semantic labels In the electronic docu- 
ment created In an application program module, the 
method comprising the steps of: 



3. The method of claim 1 , further comprising display- 
ing the plurality of actions received from the action 
plug-ins. 

5 4. The method of claim 1 , wherein the plurality of ac- 
tions are predetemnined for each of the plurallfy of 
labels. 

5. A method for associating actions with content In an 
ro electronic document as the electronic document is 

created in an a application program module, the 
method comprising the steps of: 

as the content is entered Into the electronic 
document, associating the content with a se- 
mantic label, wherein the electronic document 
is annotated with a plurality of semantic labels; 
and 

detenmlning a plurality of the actions associat- 
so ed with the label 

6. The metiiod of claim 5, further oomprfsing display- 
ing an indication that the label has been found for 
the content . 
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7. The method of claim 6, further comprising the steps 



determining that a user has selected the con- 
tent; and 

in response, displaying the piurBlity of actions 
to the user. 

The meti)od of claim 5, further comprising the steps 
of: 

receiving an indication that one of the plurality 
of actions has been selected; and 
In response to receiving an indication tiiat one 
of the plurality of actions has been selected, 
then causing the application program module 
to execute the selected action. 



The method of cialm 5, wherein the step of associ- 
ating the content with a semantic label comprises 
associating a string of text with the semantic label. 



annotating tiie electronic document with a plu- 9. 
rality of the semantic labels; 45 
receiving the plurality of labels in an action dy- 
namic iinic library; 

transmitting the plurality of labels to a plurality 1 0. 
of action plug-ins; and 

detenmlning, in the action plug-ins, a plurality of so 
actions based on the labels. 



The metiiod of claim 1, wherein the step of anno- 
tating the electronic document with a plurality of se- 
mantic labels comprises annotating the electronic ss 
document with a plurality of extensible Markup Lan- 
guage (XML) elements. 



The method of dalm 5. wherein the step of associ- 
ating the content with a semantic label comprises 
associating a graphk:ai object with the semantic la- 
bel. 

1 1 . The mettiod of claim 8, wherein the application pro- 
gram module executes the selected action by de- 
tenninlng whether an action plug-in dynamic Wnk W- 
brary assigned to the action is available; and 

If so, then receiving instructions from the ac- 
tion dynamic ii nk library assigned to the selected ac- 
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tion. 

12. Tho method of claim 11, further comprising the 
steps of: 

if an action plughin dynamic tlnic library is not 
avallabie, then using a Unifonm Resource Lo- 
cator assigned to the action to navigate to a 
Web site and download the action plug-In dy- 
namic link iSsrary. 

13. A system for associating actions with senrmntlc la- 
bels In an electronic document, the system compris- 
ing: 

an application program module for annotating 
the electronic document with a plurality of the 
semantic labels; 

an action dynamic Wvk library connected to the 
application program module receiving the plu- 
rality of labels; and 

a plurality of action plug-ins connected to the 
action dynamic link library for receiving the plu- 
rality of labels and detennlning a pluraii^ of ac- 
tions based on the labels. 

14. The system of claim 1 1 , wherein the semantic labels 
are extensible Markup Language (XML) elements. 

15. The system of claim 1 1 further comprising a display 
module for receiving and displaying the plurality of 
actions received from the actk>n plug^ns. 

16. For an electronk: system for creating and editing an 
electronic document, a computer-readable medium 
having computer-executable instnictions for asso- 
ciating a plurality of actions with semantic labels in 
the electronic document created in an application 
program module, comprising: 

annotating the electronic document with a plu- 
rality of the semantic labels; 
receiving the plurality of labels in an action dy- 
namic link library; 

transmitting tiie plurality of labels to a plurality 
of action plug-ins; and 

detennining, in the action plug-ins, the plurality 
of actions based on the labels and displaying 
the plurality of actions recehred from the plural- 
ity of action plug-Ins. 

17. Thecomputer-readablemedium of claim 12, where- 
in annotating the electronic document with a plural- 
ity of semantic labels comprises annotating ttie doc- 
ument with a plurality of extensible Markup Lan- 
guage (XML) elements. 

18. A computer-readable medium having computer-ex- 
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ecutable Instnictions for associating actions wUh 
content In an electronic document as the electronic 
document Is created in an a application program 
module, oomprfelng: 

as the content is entered into the electronic 
docunnent, associating the content with a se- 
mantic label, wherein the electronic document 
is annotated with a plurality of semantto labels; 
and 

d^rmining a plurality of the acttons associat- 
ed with the label; 

recehdng an indication that one of the plurality 
of actions has been selected; and 
In response to receiving an Indication that one 
of the plurality of acttons has been selected, 
then causing the application program module 
to execute the selected action. 



^ 19. Thecomputer-readablemediumof claim 18, where- 
in associating the text with a semantic label com- 
prises associating the text with an extensible 
Markup Language (XML) element. 

55 20. Thecomputer-readablemedlumofclaimie.further 
^ comprising displaying an indication that the label 
has been found for the content. 

21 . The computer-readable medium of claim 1 8, where- 
at) in the applicatbn program nfK>duie executes the se- 
lected action by detemiining whether an action 
plug-In dynamic link library assigned to the actk>n 
is available; end 

if so, then receiving Instmctlons frt>m the ac- 
^ tion dynamk; link library assigned to the selected ac- 
tion. 

22. The computer-readable medium of dalm 1 8, where- 
in associating the content with a semantic label 

40 comprises associating a string of text with the se- 
mantk^ label. 

23. The computer-readable medium of claim 1 8, where- 
in associating the content with a semantic label 

45 comprises associating a graphcai object with the 
semantk; label. 

24. The computer-readable medium of claim 20, further 
comprising the steps of: 



so 



55 



If an action plug-in dynamk; link library Is not 
available, then using a Uniform Resource Lo- 
cator assigned to the action to navigate to a 
Web site and download the action plug-in dy- 
namic link library. 

25. For an electronic system for creating and editing an 
electronic document, a method for associating ac- 



13 EP1376392A2 

tons with extensible Markup Language elements 
(XML) in the electronic document created in an ap- 
plication program module, the nYethod comprising 
the steps of: 

5 

annotating the electronic document with a plu- 
rality of the XML elements; 
recehdng the plurality of XML elements in an 
action dynamic link library; 
transmitting the plurality of XML elemente to a 10 
plurality of action plug-Ins; and 
detenninfng, in the action plug-Ins, a plurality of 
actions based on the XML elements. 

26. The method of claim 25, further comprising display- 
Ing the plurality of actions received from the action 
piug*lns. 

27. The method of claim 25, wherein the plurality of ac- 
tions are predetennlned for each of the XML eie- so 
ments. 
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